Resilience Testing of Health Systems: How Can It Be Done?

The resilience of health systems has received considerable attention as of late, yet little is known about what a resilience test might look like. We develop a resilience test concept and methodology. We describe key components of a toolkit and a 5-phased approach to implementation of resilience testing that can be adapted to individual health systems. We develop a methodology for a test that is balanced in terms of standardization and system-specific characteristics/needs. We specify how to work with diverse stakeholders from the health ecosystem via participatory processes to assess and identify recommendations for health system strengthening. The proposed resilience test toolkit consists of "what if" adverse scenarios, a menu of health system performance elements and indicators based on an input-output-outcomes framework, a discussion guide for each adverse scenario, and a traffic light scorecard template. The five phases of implementation include Phase 0, a preparatory phase to adapt the toolkit materials; Phase 1: facilitated discussion groups with stakeholders regarding the adverse scenarios; Phase 2: supplemental data collection of relevant quantitative indicators; Phase 3: summarization of results; Phase 4: action planning and health system transformation. The toolkit and 5-phased approach can support countries to test resilience of health systems, and provides a concrete roadmap to its implementation.

The equity dimension in evaluations of the quality and outcomes framework: a systematic review.

BACKGROUND: Pay-for-performance systems raise concerns regarding inequity in health care because providers might select patients for whom targets can easily be reached. This paper aims to describe the evolution of pre-existing (in)equity in health care in the period after the introduction of the Quality and Outcomes Framework (QOF) in the UK and to describe (in)equities in exception reporting. In this evaluation, a theory-based framework conceptualising equity in terms of equal access, equal treatment and equal treatment outcomes for people in equal need is used to guide the work. METHODS: A systematic MEDLINE and Econlit search identified 317 studies. Of these, 290 were excluded because they were not related to the evaluation of QOF, they lacked an equity dimension in the evaluation, their qualitative research focused on experiences or on the nature of the consultation, or unsuitable methodology was used to pronounce upon equity after the introduction of QOF. RESULTS: None of the publications (n = 27) assessed equity in access to health care. Concerning equity in treatment and (intermediate) treatment outcomes, overall quality scores generally improved. For the majority of the observed indicators, all citizens benefit from this improvement, yet the extent to which different patient groups benefit tends to vary and to be highly dependent on the type and complexity of the indicator(s) under study, the observed patient group(s) and the characteristics of the study. In general, the introduction of QOF was favourable for the aged and for males. Total QOF scores did not seem to vary according to ethnicity. For deprivation, small but significant residual differences were observed after the introduction of QOF favouring less deprived groups. These differences are mainly due to differences at the practice level. The variance in exception reporting according to gender and socio-economic position is low. CONCLUSIONS: Although QOF seems not to be socially selective at first glance, this does not mean QOF does not contribute to the inverse care law. Introducing different targets for specific patient groups and including appropriate, non-disease specific and patient-centred indicators that grasp the complexity of primary care might refine the equity dimension of the evaluation of QOF. Also, information on the actual uptake of care, information at the patient level and monitoring of individuals' health care utilisation tracks could make large contributions to an in-depth evaluation. Finally, evaluating pay-for-quality initiatives in a broader health systems impact assessment strategy with equity as a full assessment criterion is of utmost importance.